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HAZARDOUS MATERIALS EMERGENCY RESPONSE 
MOBILE ROBOT 

AWARDS ABSTRACT 

A simple or unsophisticated robot incapable of effecting 
straight-line motion at the end of its arm inserts a key held in 
its end effector or hand into a door lock with nearly straight- 
line motion by gently thrusting its back heels downwardly so that 
it pivots forwardly on its front toes while holding its arm 
stationary. The relatively slight arc traveled by the robot's 
hand is compensated by a compliant tool with which the robot hand 
grips the door key. A visible beam is projected through the axis 
of the hand or gripper on the robot arm end at an angle to the 
general direction in which the robot thrusts the gripper forward. 
As the robot hand approaches a target surface, a video camera on 
the robot wrist watches the beam spot on the target surface fall 
from a height proportional to the distance between the robot hand 
and the target surface until the beam spot is nearly aligned with 
the top of the robot hand. Holes in the front face of the hand 
are connected through internal passages inside the arm to an on- 
board chemical sensor. Full rotation of the hand or gripper 
about the robot arm's wrist is made possible by slip rings in the 
wrist which permit passage of the gases taken in through the nose 
holes in the front of the hand through the wrist regardless of 
the rotational orientation of the wrist. 
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JPL Case No. 18690 
NASA Case No. NPO-18690-1-CU 
Attorney Docket No. JPL/005-92 

5 HAZARDOUS MATERIALS EMERGENCY RESPONSE 

MOBILE ROBOT 

BACKGROUND OF THE INVENTION 
Origin of the Invention: 

10 The invention described herein was made in the 

performance of work under a NASA contract, and is subject 
to the provisions of Public Law 96-517 (35 USC 202) in 
which the Contractor has elected not to retain title. 
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15 Technical Field: 

The invention relates to mobile robots for 
responding to hazardous materials emergencies where 
humans cannot go, and particularly to a light weight and 
economical robot of this type having little or no on- 
20 board robot computing ability. 

Background Art: 

Hazardous materials emergencies require the 
penetration of buildings or other structures, which 
25 presents several problems. First, before deciding 

whether to open a door in such a structure, it is 
desireable to ascertain the nature of the environment 
behind the door. Secondly, opening the door may require 
the use of a key and/or the operation of a door latch and 
30 holding the door open against a self-closing mechanism. 

Use of a robot in penetrating such structures would avoid 
the risks in having humans do so. Such a robot would 
have to be self-powered, self-contained and small enough 
to fit into most passageways. However, a robot which can 
35 perform the perfectly linear motion required to insert a 

key into a door lock must have a powerful robot computing 
system consisting of either (a) a large box housing off- 
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the-shelf integrated circuits on circuit boards or (b) a 
small but expensive box containing custom integrated 
circuits. Thus, it would appear that either the robots 
compactness is compromised or else the cost of the robot 
5 is significantly increased. Also, a remote operator 

controlling the robot 1 s movement of the key via a two- 
dimensional video monitor would be hampered because 
almost all humans are accustomed to inserting keys into 
door locks with a perspective view of the key and lock 
10 (as opposed to a straight-on or frontal view afforded by 

an arm-mounted or torso-mounted camera on the robot) . 

A related problem in ascertaining the nature of the 
environment behind a door to be opened is that a sensor 
15 (such as a chemical sensor) held at the end of the 

robot’s arm must be positioned by the robot next to the 
space between the door and the door jamb. An operator 
viewing a video monitor while attempting to manually 
control the robot to perform such a task would be unable 
20 to gauge the robot arm's distance and speed relative to 

the door jamb, without the of a proximity sensor. 
Unfortunately, a proximity sensor must be interfaced to 
additional processing electronics and, in some cases, to 
the robot’s on-board computer in order to acquire, 

25 transmit and display the speed or distance measurement to 

the operator. Hence, the electronic integration of a 
conventional proximity sensor has a significant impact 
upon various other components of the overall system. 

30 Another problem in ascertaining the nature of the 

environment behind a door to be opened is that it is not 
desirable to hold the sensor (e.g., the chemical sensor) 
at the end of the robot arm, since it might be broken by 
accidental impact with the door or door jamb due to the 
operator's inability to judge the speed or range of the 
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arm relative to the door jamb. Thus, the arm might hold 
in its hand or gripper the open end of a flexible hose 
line whose other end is connected to the input of the 
chemical sensor mounted at a safer location on the robot. 

5 The problem is that as the gripper rotates with the arm 

to perform other tasks, the hose will eventually twist 
too far and either jam the arm or break. 

Operating a robot is difficult for the uninitiated, 
10 because the operator manually controls joint motion in 

such robots and must therefore mentally predict the joint 
motion required to effect the desired hand or gripper 
motion. Moreover, the operator must know which control 
knob (or "joystick") controls a particular one of the 
15 several joints of the robot. Depending upon the 

immediate robot arm configuration and the desired hand 
motion, there can be an inverse relationship between the 
direction of joint motion and the direction of the hand 
motion, slowing or preventing appropriate operator 
20 action. Thus, the concept of an economical and 

unsophisticated hazardous materials emergency response 
robot of the type which every municipality could afford 
as standard fire station equipment and which could be 
readily and reliably operated in an emergency with a 
25 modicum of prior training has not seemed practical in 

view of the foregoing. 

Various techniques related to the foregoing are 
known in the art. For example, a remote control robot 
30 for hazardous environments is disclosed in U.S. Patent 

No. 4,652,204, but is not truly a self-contained mobile 
robot. U.S. Patent No. 5,031,304 discloses compliant 
tools for use by a robot. U.S. Patent No. 's 4,800,802 
and 4,290,203 disclose various compliant tools for 
general use. U.S. Patent No.'s 4,819,184 and 4,676,713 
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disclose, respectively, joysticks and rocker switch 
panels for robots. U.S. Patent No.'s 4,615,615 and 
4,843,565 disclose laser range finders. 
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SUMMARY OF THE INVENTION 

The foregoing problems are overcome in the hazardous 
materials emergency response robot of the present 
invention. A simple or unsophisticated robot incapable 
of effecting straight-line motion at the end of its arm 
inserts a key held in its end effector or hand into a 
door lock with nearly straight-line motion by gently 
thrusting its back heels downwardly so that it pivots 
forwardly on its front toes while holding its arm 
stationary. The relatively slight arc (determined by the 
height of the robot's hand above the robot's front toes) 
traveled by the robot's hand is compensated by a 
compliant tool with which the robot hand grips the door 
key. As the front part of the key is inserted into the 
door lock, the interaction of the key and the lock 
produces a force on the compliant tool, causing the tool 
to bend slightly in accordance with the slightly arcuate 
motion of the robot hand, thus permitting the key to 
continue being inserted into the lock in a straight line 
without jamming inside the lock. 

Once unlocked, the robot pulls the door open by 
pulling on the compliant tool while the key is still 
engaged in the door lock. In order to accomodate the 
rotation of the door as it is being pulled open by the 
robot backing up, the compliant tool holding the key is 
connected to the robot hand gripper through a rotating 
joint which rotates in a horizontal plane about a 
vertical axis, corresponding roughly to the axis of 
rotation of the door. The compliant tool and key rotate 
about the vertical axis up to nearly a right angle with 
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respect to the robot hand, depending upon how far the 
door is rotated by the pulling motion of the robot. 

The operator is apprised of the range and speed of 
5 the robot's hand relative to the door lock (or any target 

object) in an instinctive manner that any untrained 
operator can immediately grasp and respond to. 
Specifically, a visible beam from an inexpensive source 
(such as a laser) is projected through the axis of the 
10 hand or gripper on the robot arm end at an angle to the 

general direction in which the robot thrusts the gripper 
forward. As the robot hand approaches a target surface 
(such as the exterior surface of a door) , a video camera 
on the robot wrist watches the beam spot on the target 
15 surface fall from a height proportional to the distance 

between the robot hand and the target surface until the 
beam spot is nearly aligned with the top of the robot 
hand (at which point the robot hand is touching the 
target surface) . While the height of the beam spot 
20 indicates distance-to-go, the rate at which the spot 

falls in the field of view indicates the speed of the 
hand relative to the target surface. If the surface is 
non-perpendicular to the general direction of forward 
motion of the robot hand, then a conical beam may be 
25 employed, which will be observed as an ellipse on an 

target surface whose eccentricity indicates the angle of 
the surface. 

In order to provide the operator a perspective view 
30 of the robot's hand, a side camera is movably mounted on 

a horizontal cantilevered side arm extending away from 
the robot arm in a direction generally transverse to the 
robot arm. In order to avoid collisions between the side 
camera and the robot arm or hand, the cantilevered side 
arm supporting the side camera is mounted on the robot 
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arm above the arm's horizontally pivoting joint, so that 
all horizontal motions of the arm move the side camera. 

The operator therefore views the robot action on two 
video monitors, one for the camera mounted on the robot 
5 arm or hand and the other for the side camera. 

In order to open latched doors (i.e., doors which 
require depression of a thumb latch while pulling on a 
door handle) , the robot includes a remotely controlled 
10 winch mechanism for deploying and retrieving a specially 

designed hook attached to the end of a fine cable. To 
open such a door, the robot arm grasps the hook located 
in the front of the vehicle and hooks it on the door 
handle. During this operation, a moderate amount of 
15 tension is maintained on the cable by a spring loaded 

mechanism within the winch. This tension insures that 
the hook will remain on the door handle once the robot 
arm lets go of the hook. 

20 After releasing the hook, the robot arm depresses 

the door latch. The winch mechanism is then switched to 
its locked position which prevents the cable from being 
pulled out any further. Then the robot is driven 
backwards several inches, causing the cable to pull the 
25 door open while the robot arm is simultaneously 

depressing the door's thumb latch. At this point the 
door is slightly opened, and the robot arm can release 
the door latch (by moving away from the door) . Then, 
either the robot can back up further or the winch can be 
30 activated to reel in the cable, so as to open the door to 

a nearly completely open position. At this point the 
robot arm reaches around to the back of the vehicle and 
grasps a weighted bag (a dead weight) which is carried by 
the robot. By placing the weighted bag near the inside 
bottom of the door and by then rotating the robot arm 
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side ways, pushing on the door, the door can be opened 
completely. When the robot arm and weighted bag make 
contact with the inside of the door, the winch is 
switched from its locked position so that the cable will 
5 be passively paid out when the robot arm pushes on the 

door. The robot arm ungrasps the weighted bag which then 
falls to the ground and secures the door in its fully 
open position. The robot arm is then used to grasp the 
cable just behind the hook to release the tension on the 
10 portion of the cable between the grasp point on the cable 

and hook. This causes the hook to automatically fall off 
of the door handle due to its weight distribution and its 
shape. Finally, the robot arm can ungrasp the hook which 
will automatically be retrieved since the winch mechanism 
15 is still in its spring loaded mode of operation. 

Prior to opening or unlocking a door, in the context 
of responding to a chemical hazard, it is desirable to 
have the robot first sense for hazardous gases which may 
20 be escaping through the door jamb. For this purpose, the 

invention includes a sniffer (nose) built into the 
robot's gripper/arm. Preferably, holes in the front face 
of the hand are connected through internal passages 
inside the arm to an on-board chemical sensor. Full 
25 rotation of the hand or gripper about the robot arm's 

wrist is made possible by slip rings in the wrist which 
permit passage of the gases taken in through the nose 
holes in the front of the hand through the wrist 
regardless of the rotational orientation of the wrist. 

30 

In conjunction with the foregoing feature, the 
operator uses the spot projected by the laser beam which 
is displayed to him/her on the control station's video 
screen to monitor and rapidly deduce the range and rate 
of change in the range of the robot's finger tips from 
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the door jamb. The range and rate of change in the range 
are easily inferred by observing in the video screen the 
position (i.e., height) and motion of the projected laser 
beam spot with respect to the image of the robot's 
fingers. This greatly simplifies the task of placing the 
robot's finger tips, and hence the chemical sensor's 
nose, at the door jamb where the robot will "smell" for 
the presence of dangerous chemicals behind the door. 

In order to enable a relatively untrained operator 
to readily control the robot in response to viewing a 
video display of the motion of the robot, all of the 
controls (e.g., joysticks) controlling the various joints 
of the robot are mounted over a two-dimensional 
background graphical projection or representation of the 
robot clearly illustrating its links and joints. Each 
control or joystick or knob controlling a joint is 
mounted on the corresponding joint in the two-dimensional 
representation of the robot. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a side view of a robot embodying the 
invention . 

Fig. 2 is a side view of the movable tracks of the 
robot . 


Fig. 3 is a side view of a compliant key holder 
embodying one aspect of the invention. 

Fig. 4 is a top view of the compliant key holder of 
Fig. 3 rotated through a right angle about the axis of 
the key. 

Fig. 5 is a side view of the end effector of the 


9 


robot of Fig. 1. 

Fig. 6 is a side view corresponding to Fig. 1 
illustrating how the robot is tilted forward on its front 
5 toes to insert a key in accordance with another aspect of 

the invention. 

Fig. 7 is a schematic diagram of a camera and beam 
source for creating a display of range and rate. 

10 

Fig. 8 is a pictoral diagram of a display of range 
and rate from the camera of Fig. 7. 

Fig. 9 is a perspective view of environmental 
15 sensing features in parallel gripper jaws of the robot of 

Fig. 1 in accordance with yet another aspect of the 
invention . 

Fig. 10 is a top view of a robot control panel 
20 embodying still another aspect of the invention. 

Fig. 11a is a diagram of specially designed hook in 
accordance with a further aspect of the invention for 
opening latched doors in the operation illustrated in 
25 Fig.'s lib through lid. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to Fig. 1, a robot embodying the invention 
includes a main track drive 10, a front articulated track 
30 drive 12 and a rear articulated track drive 14. Both 

articulated track drives may articulate so as to raise or 
lower themselves above or below the height of the main 
track drive as shown in Fig. 2. The main track drive 10 
supports a chassis 16 from which a standoff 18 extends 
upwardly. A torso joint 20 attached to the top of the 
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standoff 18 rotates in a horizontal plane while a 
vertical shoulder joint 24 rotates in a vertical plane. 

A shoulder link 22 is connected to the shoulder joint 24 
and moves with rotation of either of the joints 20 or 24. 
An elbow joint 26 connected to the distal end of the 
shoulder link 22 supports rotation of a forearm link 28 
in a vertical plane, while a vertical wrist joint 30 
connected to the distal end of the forearm link 28 
supports rotation of a wrist 32 in a vertical plane. A 
wrist roll joint 34 connected to the wrist 32 supports 
rotation of a parallel gripper jaw 36 in a vertical plane 
orthogonal to that of the vertical wrist joint 30. 

Opening a locked door with a key is performed with 
the compliant key holding tool 40 of Fig. 's 3 and 4 held 
in the parallel gripper jaw 36 as shown. The tool 40 is 
compliant in two axes by deformation of two orthogonal 
leafs 42, 44. At the distal end of the far lear 44, a 
cylindrical key housing 46 holds a key 48 with a set 
screw 50. A circular flange 52 supports four deformable 
tangs 54, 56, 58, 60 whose distal ends 62, 64, 66, 68 fan 

out radially with respect to the axis of the key housing 
46 so as to register the axis of the cylindrical key 
housing with the center of door knob 70 as the key 48 is 
thrust toward the door knob 70 by the robot. 

An operator manually controls motion of all of the 
robot joints 20, 24, 26, 30 and 34 while viewing the 
operation via a camera 72 mounted on the wrist 32 inside 
a camera housing 74 (as shown in Fig. 5) and via a side 
camera 76 mounted on a cantilevered side boom 78 
supported by and rotating with the torso joint 20 (as 
shown in Fig. 1). By being forced to rotate with the 
torso joint 20, the side camera 76 is safe from collision 
with the gripper 36 or any of the intervening robot 


links. The side camera 76 provides excellent and 
remotely controllable side viewing of delicate operations 
such as that of inserting the key 48 into a keyhole 80 in 
the door knob 70. The ability to control and optimize 
the viewing angle in such tasks is critical to 
performance of the system and also makes it much easier 

to use. 

In order to insert the key 48 into the key hole 80, 
the motion of the key 48 must be at least nearly 
perfectly linear to avoid jamming it in the key hole 80. 
For this purpose, the operator causes the robot to 
maneuver until the axis of the key 48 and the axis of the 
key hole 80 are aligned and the key 48 touches the 
outside of the key hole 80. Alignment of the key 48 with 
the key hole 80 requires rotation of the gripper jaw 36 
by the wrist roll joint 34. Then, as shown in Fig. 6, 
the operator causes the rear articulated track 14 to 
gradually thrust downwardly below the height of the main 
track 10, which causes the robot to rock forward on its 
"toes" (i.e., to rock forward over the front articulated 
track 12) , thus creating a nearly linear forward motion 
of the key 48 into the key hole 80. The slight arcuate 
shape of the path of the gripper jaw 36 holding the key 
48 is compensated by a slight deformation of the leafs 
42, 44 of the compliant tool 40 in response to a slight 
force exerted on the key 48 by interior surfaces (e.g., 
lock tumblers) within the key hole 80. 

The door is unlocked by rotating the gripper jaw 36 
and key 48 by the wrist roll joint 34 in the appropriate 
angular direction. A conventional slip clutch 82 
coupling the proximal leaf 42 with the gripper jaw 36 
permits the gripper jaw 36 to rotate beyond the 
rotational position at which the key 48 reaches its limit 
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of rotation within the key hole 80. Typically, then, the 
operator may command the wrist roll joint 34 to rotate 
through 180 degrees, for example. Once the door is 
unlocked, it is opened by moving the robot backwards away 
5 from the door while the key 48 continues to be engaged in 

the key hole 80. This causes the compliant tool 40 to 
compensate for the resulting rotation of the door and key 
46, first by bending the leaf 42 and the leaf 44 and 
finally by rotating the distal portion of the compliant 
10 tool 40 about a passive vertical joint 84 of the tool 40. 

The passive vertical joint 84 is preferably of the 
conventional type which rotates upon the application of a 
predetermined threshold rotational force. The bending of 
the key tool's compliant members provides the operator 
15 with visual cues as to the progress of the operation, 

since the bending can be directly viewed by the operator 
via the wrist mounted camera 72. 

As illustrated in Fig. 7, a laser beam source 86 
20 projects a laser beam 88 at an acute angle with respect 

to the line of sight between the camera 72 and the end 90 
of the gripper jaw 36. The video display of Fig. 8 
generated by the camera 72 shows the right and left 
fingers 92, 94 of the gripper jaw 36 and a spot 96 

25 illuminated by the laser beam 88 on the door to a remote 

operator. The height H of the spot 96 relative to the 

tips of the fingers 92, 94 is an analog display of the 

distance - to— go while the rate of downward vertical travel 
of the spot 96 in the video display is an analog 
30 indication of the speed of the finger tips relative to 

the door surface, which the operator can readily 
understand and respond to. 

Prior to deciding whether or not to open the door, 

35 the operator determines the nature of the environment 
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behind the door by positioning the tips of the fingers 
92, 94 against the top of the crack between the door and 
the door jamb, and "sniffs" any gases escaping therefrom 
via nose holes 100 (Fig. 9) in the front faces of the 
5 tips of each of the fingers 92, 94. Interior sealed 

passageways 102, 104 conduct the gases received through 

the holes 100 back through the interiors of the fingers 
92, 94 and through a conventional slip ring sealed rotary 
joint of the wrist roll joint 34, and thence to a sensor 
10 108 (e.g., a chemical or nuclear sensor) within the 

housing 74 (Fig. 5) . An air pump 110 creates a pressure 
gradient which draws air in through the nose holes 100. 

Referring to Fig. 10, in order to simplify the 
15 operator's task of controlling all of the robot joints to 

effect each one of the motions described above, the 
motion of each joint is controlled through conventional 
servo mechanisms by finger-actuated control devices 
including spring-returned rotating knobs 122, 124, 126, 

20 132, 134, 136 and single axis joy sticks 120, 128, 130, 

138, 140 mounted on images of corresponding joints in a 

two-dimensional graphical representation of the robot 
printed on the surface or panel of a control box 129. 

The finger-actuated control devices 120, 122, 124, 126 

25 and 128 control joints 20, 24, 26, 30 and 34, 

respectively, and are mounted on images of those 
respective joints. The single axis joy stick 130 
controls the opening and closing of the fingers 92, 94 of 
the parallel gripper jaw 36. The spring-returned 
30 rotating knobs 132, 134 control the articulating front 

and rear tracks 12 and 14, respectively. The spring 
returned control knob 136 and the single axis joy stick 
138 control the vertical and horizontal rotation of the 
side camera 76 while the single axis joy stick 140 
controls horizontal rotation of the side boom 78. 
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In order to open latched doors (i.e., 
require depression of a thumb latch while pulling on a 
door handle) , the robot includes a remotely controlled 
winch mechanism 142 for deploying and retrieving a 
specially designed hook 144 attached to the end of a fine 
cable 147 (Fig. 11a). As shown in Fig. 11a, the 
specially designed hook 144 is attached at its proximal 
end to a weight 146, and the curvature of the end of the 
hook 144 is limited to being about a half circle. To 
open such a door, the robot arm grasps the hook 144 
located in the front of the vehicle and hooks it on a 
handle 148 of door 150. During this operation, a 
moderate amount of tension is maintained on the fine 
cable 147 by a conventional spring loaded mechanism (not 
shown) within the winch 142. This tension insures that 
the hook 144 will remain on the door handle 148 once the 
robot arm lets go of the hook 144, as shown in Fig. lib. 

After releasing the hook 144, the robot arm 
depresses the door latch 152 (Fig. lib) . The winch 
mechanism 142 is then switched to its locked position 
which prevents the cable 147 from being pulled out any 
further. Then the robot is driven backwards several 
inches, causing the cable 147 to pull the door 150 open 
while the robot arm is simultaneously depressing the 
door's thumb latch 148. At this point the door 150 is 
slightly opened, and the robot arm can release the door 
latch 152 (by moving away from the door 150) . Then, 
either the robot can back up further or the winch 142 can 
be activated to reel in the cable 147, so as to open the 
door 150 to a nearly completely open position. At this 
point the robot arm reaches around to the back of the 
vehicle and grasps a weighted bag 154 (a dead weight) 
which is carried by the robot. By placing the weighted 
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bag 154 near the inside bottom of the door 150 (Fig. 11c) 
and by then rotating the robot arm side ways, pushing on 
the door 150, the door 150 can be opened completely. 

When the robot arm and weighted bag 154 make contact with 
the inside of the door 150, the winch 142 is switched 
from its locked position so that the cable 147 will be 
passively paid out when the robot arm pushes on the door 
150. The robot arm ungrasps the weighted bag 154 which 
then falls to the ground and secures the door 150 in its 
fully open position. Referring to Fig. lid, the robot 
arm is then used to grasp the cable 147 just behind the 
hook 144 to release the tension on the portion of the 
cable 147 between the grasp point on the cable 147 and 
hook 144. This causes the hook 144 to automatically fall 
off of the door handle 148 (Fig. lie) due to its weight 
distribution and its shape. Finally, the robot arm can 
ungrasp the hook 148 which will automatically be 
retrieved since the winch mechanism 142 is still in its 
spring loaded mode of operation. 

While the invention has been described by specific 
reference to preferred embodiments thereof, it is 
understood that variations and modifications thereof may 
be made without departing from the true spirit and scope 
of the invention. 
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HAZARDOUS MATERIALS EMERGENCY RESPONSE 
MOBILE ROBOT 

ABSTRACT OF THE INVENTION 
A simple or unsophisticated robot incapable of 
effecting straight-line motion at the end of its arm 
inserts a key held in its end effector or hand into a 
door lock with nearly straight-line motion by gently 
thrusting its back heels downwardly so that it pivots 
forwardly on its front toes while holding its arm 
stationary. The relatively slight arc traveled by the 
robot's hand is compensated by a compliant tool with 
which the robot hand grips the door key. A visible beam 
is projected through the axis of the hand or gripper on 
the robot arm end at an angle to the general direction in 
which the robot thrusts the gripper forward. As the 
robot hand approaches a target surface, a video camera on 
the robot wrist watches the beam spot on the target 
surface fall from a height proportional to the distance 
between the robot hand and the target surface until the 
beam spot is nearly aligned with the top of the robot 
hand. Holes in the front face of the hand are connected 
through internal passages inside the arm to an on-board 
chemical sensor. Full rotation of the hand or gripper 
about the robot arm's wrist is made possible by slip 
rings in the wrist which permit passage of the gases 
taken in through the nose holes in the front of the hand 
through the wrist regardless of the rotational 
orientation of the wrist. 
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